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ABSTRACT 


Assume  that  a  device  is  subject  to  wear.  Over  time  the  wear  is 

assumed  to  be  an  increasing  Levy  process(Xt).  Suppose  the  device  has 

a  threshold  Y  with  right-tail  probability  G.  Let  £  be  the 

failure  time  of  the  device  and  Fx  be  its  survival  probability  given 

that  Xq  *  x.  It  is  shown  that  life  distribution  properties  of  G 

are  inherited  as  corresponding  properties  of  F  for  each  x  e  R  . 

x  + 

Optimal  replacement  policies  for  such  devices  are  discussed  for  suitably 
chosen  cost  functions  when  the  failure  rate  of  G  is  bounded  and 
continuous  a.e.  on  the  support  of  G  . 
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Life  Distribution  Properties  of  Devices 
«■» 

Subject  to  a  Levy  Wear  Process 
by 

M.  Abdel-Hameed 

ABSTRACT 


Assume  that  a  device  is  subject  to  wear.  Over  time  the  wear  is 


Suppose  the  device  has 


assumed  to  be  an  increasing  Levy  process 
a  threshold  Y  with  right-tail  probability  Gr.  Let  £  be  the 
failure  time  of  the  device  and  F  be  its  survival  probability  given 
that  X_  =  x.  It  is  shown  that  life  distribution  properties  of  G 
are  inherited  as  corresponding  properties  of  F  for  each  x  e  R  ■<=- 

,Jw:"  X  '  + 

Optimal  replacement  policies  for  such  devices  are  discussed  for  suitably 
chosen  cost  functions  when  the  failure  rate  of  G  is  bounded  and 


continuous  a.e 


on  the  support  of  G  . 


1.  INTRODUCTION. 


Let  (ft,F,P)  be  a  probability  space.  On  it,  X  =  (Xfc)  is  an 
increasing,  right  continuous,  pure  jump  process  with  independent 
incredments,  XQ  s  0.  Every  such  X  has  the  form  (see  ITO(196?)) 


X  =  I  (X  -X  )  , 
t  ..  s  s- 
s*t 


and  f  or  eirery  Borel  set  B  <=  C0,°°)x(0,°°)  , 


N(B)  =  Z  1_ (s,X  -X  ) 

B  S  S- 

s>0 

has  the  Poisson  distribution  with  some  mean  n(B) ;  it  follows  then 

that  N(B  ) , . , . ,N(B  )  are  independent  whenever  B . B  are 

disjoint.  We  assume  that  the  mean  measure  n  has  the  form 

n(ds ,dy)  *  A(ds)y(dy)  ,  s > 0,  y >  0. 

Then,  y  is  necessarily  a  Levy  measure,  that  is,  u  satisfies 

fu(dy)  (yAl)  k  «  , 

which  in  turn  implies  that  y((e,®))<  00  for  every  e  >  0  , 

and  A  is  an  arbitrary  measure  on  (O,00)  with  0  S  AC0,t]  <  °°  for 
every  t  .  Finally,  we  assume  that  the  function  t->-A(t)  =  AC0,t] 
is  continuous  (necessarily  increasing  and  has  A(0)  =  0). 

Since  n  is  assumed  to  have  the  product  form  Axy  ,  it  is 


possible  to  do  a  deterministic  time  change  to  cause  X  to  have 
stationary  and  independent  increments.  Let  t  be  the  right 


continuous  functional  inverse  of  A  ,  i.e. 


t(u)  =  inf  (t:A(t)  >  u}  ,  ueR+  , 

and  set 


X 

u 


"  Xt(u) 


ueR 


+ 


Then,  X  is  an  increasing  pure  jump  process  with  stationary  and 
independent  increments,  a  Levy  process.  If  N  is  defined  for 
X  as  N  was  for  X  ,  then  N  is  a  Poisson  random  measure  with 
mean  measure  n(ds,dy)  «  dsp(dy). 


For  x  in  R+  the  probability  measure  Px  is  determined  by 

PX{X  eA  , i=l , . . . ,n}  =  P{X  eA  -x, i=l , . . . ,n} 
i  Ci  1 

and 


PX{XQ=x}  =  1. 

Let  (tl'.F'.P')  be  another  probability  space  and  Y  be  a 
nonnegative  random  variable  defined  on  it.  For  each  x  in  R+ 
def  ine 


P'x  =  p'(  | y>x)  . 

The  measure  on  ■  J2x  W  is  defined  as  the  product  measure 

P*  =  P*  x  P’X,  E^CE*)  denotes  the  expectation  w*r-t'PX(Px)  and  E  E° 

We  interpret  Xfc  as  the  amount  of  deterioration,  or  wear, 
suffered  by  the  device  during  [0,tl  ,  and  Y  as  the  threshold 
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strength  of  the  device,  so  that 
C  -  inf  {t:  Xu  ;>  Y) 

is  the  failure  time  of  the  device.  Define,  G(x)  =  P'(Y>x)  and 
A  =  {x:  5(x)  f  0).  Note  that  if 

E  *  inf  {u:  Xy  £  Y}  , 

then 

C  ■  A(t)  and  C  »  t(£)  almost  surely.  It  follows  that 

F  (t)  =  P*U  >  t}  **  P* {Y  >  X  } 
x  t 

,  xeA 
,  x/A  . 


,  xcA 

,  xM  , 

is  the  survival  probability  corresponding  to  e  . 

In  Section  II  we  show  that  life  distribution  properties  of  the 
threshold  Y  are  inherited  as  corresponding  properties  of  the  failure 


(1-1) 


j'Exi:G(xt)D/e<x) 


Moreover, 


where 


Fx(t)  *  Px(A(t))  , 


Fx(u)  -  P*{^  >  u} 


(1.2) 


f  EXCG(Xu)]/G(x) 

l  0 


time  r,,  under  appropriate  conditions  on  the  function  A(t). 

In  Section  III  we  determine  the  form  of  the  optimal  replacement 
policies  for  such  devices  for  properly  chosen  cost  functions. 

Throughout,  the  word  "increasing"  will  be  used  to  mean'hon- 
decr easing*' and  "decreasing"  will  mean  "nonincreasing". 

II.  PRESERVATION  OF  LIFE  DISTRIBUTIONS. 

Assume  that  a  device  is  subject  to  wear  occuring  according  to 
the  increasing,  right  continuous,  pure  jump  process  with  independent 
increments  described  in  Section  I.  The  device  has  a  certain 
threshold  Y  defined  on  (fi ' ,  F'  ,P  * )  .  The  device  fails  once  the 
wear  exceeds  or  equals  to  the  threshold.  Let  G  be  the  right  tail 
probability  of  the  threshold  Y  and  A  =  {x:  G(x)  ^  0‘.  Then 
for  any  x  in  R+  the  survival  probability  of  the  device  is  defined 
by  equat ion  (1.1). 

In  this  section  we  prove  that  life  ' *str Ihut ion  properties 
of  the  threshold  right  tail  probability  G  are  inherited  as  corresponding 
properties  of  the  survival  probability  F^  under  suitable  conditions 
on  the  function  A. 

2.1.  DEFINITION.  Let  x  c  R^  and  C  be  the  failure  time  with 
survival  probability  F  .  Define  U  =  (t:  F  (t)  s  01.  Then 

X  XX 


is  said  to  have: 


F 

x 

(i)  increasing  (decreasing)  failure  rate  if  Px(i;>t  +  s|c>t) 
is  nonincreasing  (nondecreasing)  in  t  e  for  each  s  e  R+: 

(ii)  increasing  (decreasing)  failure  rate  average  if 

EXf(^)  £  (>)  [jP'f  a(  c  |  a)  for  each  0  <  a  <  1  and  each  nondecreasing 

function  f:  R  -*•  R+  . 

(iii)  new  better  (worse)  than  used  if  E^Cf^)!]  s(<)  E^Lf^  -  s)  1 1,  >  s] 
for  each  nondecreasing  function  f:  R  -*•  R+  and  each  s  e  R+  . 

A  detailed  investigation  of  these  classes  is  given  in  Barlow  and 
Proschan  C  2 ]  . 

The  following  shows  that  life  distribution  properties  of  the 
function  G  inherited  as. correspond ing  .propert ies  of  the  survival 
probability  given  by  (1.1),  under  appropriate  conditions  on  the 
function  A. 

2.2.  THEOREM.  Let  be  given  by  (1.1)  .  Assume  the  Ldvy  measure  u 
is  finite.  Then  the  following  hold: 

(i)  If  G  has  an  increasing  failure  rate  and  A  is  convex  and 
U  <  <  Leb  with  a  density  f  that  is  Polya  frequency  function  of 
order  two  (PF„)  ,  then  F  (t)  has  increasing  failure  rate. 

(ii)  If  G  has  a  decreasing  failure  rate  and  A  is  concave,  then 
Fx  has  a  decreasing  failure  rate  for  each  x  c  R+ 

(iii)  If  G  has  increasing  failure  rate  average  and  A  is  starshaped, 
then  Fx  has  increasing  failure  rate  average  for  eaeh  x  e  R+  . 

(lv)  If  ^  has  decreasing  failure  rate  average  and  A  is  antistar shaped 
and  y  <  <  Leb  with  PF£  density,  then  F(t)  has  decreasing  failure  rate 


average. 


(...)  if  G  is  new  better  than  used  and  is  superadd  it  ivt .  the:, 

for  each  i  l  (0,1)  and  x,  t,  s  ■-  Pv  we  have 

~  (t-t-s)  t  "f  (t)  "F,  .  (s).  in  particular  F  is  new  better  than  used, 

x  ax  (l-a)x 

(vi)  If  G  is  new  worse  than  used  and  is  subadditive,  then  for 

each  x  e  R+  ,  Fx  is  new  worse  than  used. 

2.3  REMARK  By  an  argument  similar  to  the  one  used  in  the  proof  of 
Theorem  (3.1)  of  Ahdel-Hameed  and  Proschan  1  ,  it  suffices  to  prove  th 

properties  of  F  in  terms  of  those  of  G  and  _ ,  and  tnen  draw  the 

conclusion  for  the  non-stat  ionarv  case  hv  using  the  relation 
F  =  F  o 

PROOF  OF  THEOREM  2.2  ( 1) .  Let  N(t)  be  the  number  of  jumps  of  X  . 
during  (0,t ]  and  u  ^  is  the  k  ^  convolution  of  u ,  then 

Fx(t)=Ex  [u(N(t))G(x)]/G(x) 

where  for  each  k  >  0,  y^G(x)  =  G(x+y)p^  (dy) ,  RQ  =  R+\{0}. 

R0 

Since  F^Ct)  =  E*  G(Xt)/G(x)  ,  then  it  suffices  to  show  that 
K^(t)  r  EX  G(X^)  has  increasing  failure  rate.  Since  f  is  a  Polya 
frequency  of  order  two,  then  it  follows  by  an  argument  similar  to 
the  one  used  in  proving  Theorem  4.9  of  Esary,  Marshall  and  Proschan 
C  6  J  that  f  (x)  is  TP2  in  k  and  x  .  Since  G  has  increasing 
failure  rate  implies  that  G^Cy)  =  G(x+y)  enjoys  the  same  property 
for  each  x  ,  then  the  result  follows  from  Theorem  5.4  of  Karlin  C  10  3, 
page  130. 

PROOF  OF  (ii).  It  suffices  to  show  that  has  decreasing 

failure  rate.  It  is  evident  that  K  is  differentiable 

x 

and  has  decreasing  failure  rate  if  and  only  if  the  function 
f:  CO,®)  -*■  CO,  1 3  given  by  f  (t)  ■  v  K  (t)/K  (t)  is  nondecreasing 

in  t  c  R+  for  each  x  c  R+  . 
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This  is  true  if  and  only  if  for  each  z  e  R^,  x  e  R+  such  that 
x  +  z  t  A, 


D(tlft2) 


Wh>  K*(t2>  -  Wh>  K,<t2> 


is  non  positive  for  t^  s  t2>  t^  ,  t2  £  .  By  the  "Basic  Composition 

Formula"  (Karlin  C 10 U  ,  page  17)  we  have  that 


D(tist2)  -  LI 


k  <  k 
1  -  K2 


PCtj.kp  PU^) 
PCtj.k^  P(t2,k2) 


(K  )tt/ 


u"  l'GCx+z)  /  rG(x) 
U(k2)G(x+z)  y^GCx) 


where  P(t,k)  is  the  Poisson  kernel  which  is  totally  positive  of 

all  orders.  Therefore  for  each  k^  ,  k2  in  the  domain  of  the  sum 

the  first  determinant  is  nonnegative  and  we  only  need  tc  show  that 

for  such  k^  and  k2  the  second  determinant  in  the  sum  is  nonpositive. 

Ck)— 

This  is  true  if  for  each  k  ^  0,  the  function  o(k,x)  =  u  G(x) 

(k)— 

has  decreasing  failure  rate.  But  y  G(x)  is  a  mixture  of 
G^(x)^-^G(x+y)  with  respect  to  y^k)  and  decreasing  failure  rate 
property  is  preserved  under  mixtures. 


PROOF  OF  ( iii) .  Since  ?x(t)  =  EXG(Xt>/G(x)  ,  and  since  CG(x)3-1/t 
is  decreasing  in  t  ^  0  ,  then  it  suffices  to  show  that  EXG(Xt) 
has  increasing  failure  rate  average.  Tt  suffices  to  show  that 

K  (t)  has  increasing  failure  rate  average.  Since  K  (t)  =  E  C(X  +  x) 
x  X  t 

and  the  function  G^(y)  =  G(x+y)  has  increasing  failure  rate  average 
when  G  does,  then  the  result  is  immediate  from  Theorem  5.2  of 
Esary,  Marshall  and  Proschan  [[63* 

PROOF  OF  ( iv) .  It  suffices  to  show  that  Kg(t)  has  decreasing 
failure  rate  average.  Since  G  has  decreasing  failure  rate  average 
if  and  only  if  G(x)  -  e  changes  sign  at  most  once  and  if  once 

in  the  order  +,-  .  Since  the  density  f  is  PFj,  then  the 
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compound  Poisson  kernel  £(t,x)  “  l  P(t,k)  fv  ' (x)  is  totally 

k  20 

positive  of  order  two  and  therefore 

K0(t>  -  e^(X)t  =  E  [G(Xt)  -  e"X*t] 
changes  sign  at  most  once  and  if  once  in  the  order  -  ,  +  ,  by 
"The  Variation  Diminishing  Property",  Karlin  [  10  ],  page  21. 

Note  that  the  average  of  the  failure  rate  is  Less  than  or  equal  to 
f 

I  u(dy)  =  iim  iKX)  .  Tne  function  is  increasing  ana  MO)  =  0. 

R0  X-*» 

Therefore,  has  decreasing  failure  rate  average. 

PROOF  OF  (v) .  It  suffices  to  show  that  K^ft)  enjoys  the  desired 
property.  Now  write, 

Kx(t+s)  =  EX[c(Xt+g) ] 

=  E[G(Xt+f;  + 

[by  definition  of  P  ] 


E[G(X  -  X  +  ax  +  X  +  (l-a)x)] 
t+s  s  s 


<  E[G(X  ,  -  X  -  ax )  G  ( X  +  (l-a)x)] 

t+s  s  s 

=  E[G(Xt  +  oxQeCC(Xs  +  (l-a)x)] 

Cby  the  stationarity  and  independence 
of  the  increments] 

=  EOXCG(XtaE(1‘<*)*  CG(Xg)3 


=  R  (t)  Kr  ,  (s) 
ax  Ll-a)x 


i 
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PROOF  OF  (vi) .  By  an  argument  similar  to  the  one  used  in  proving 
(v)  and  reversing  the  direction  of  the  inequalities,  an  operation 
justified  since  G  is  new  worse  than  used  instead  of  being  new 
better  than  used  we  get  for  each  t,  s  e  R+  and  a  t  (0,1) 

K^Ct+s)  s  K^ft)  K  (s) 

^  a"  (l-a)x 

>  K  (t)  K  (s) 
x  x 

Caince  decreases  in  x  ] 

Therefore  K  is  new  worse  than  used  for  each  x  £  R,  . 

The  following  T1  aorem  is  the  key  theorem  in  this  section. 

2.4.  THEOREM.  The  results  of  Theorem  2.2  hold  for  infinite  Levy 
measures,  i 

PROOF.  We  only  prove  (i),  the  other  cases  follow  similarly. 

First  write  for  n  e N+  \{0} 

-  |  y  N(ds,dy) 

[0,t]x  (”  ,«) 

Observe  that  the  Ldvy  measure  associated  with  is  of  the  form, 

vn(dt,dy)  -  Mdt)  un(dy)  where  yn(dy)  *  y(dy)I  n  (y) . 

<n 

Since  y  is  a  Levy  measure,  then  y  ,  «■>)<  «  for  each  n  and 
thus  yn 


is  a  finite  measure. 


has  ini' rears  i-ng 


For 


n  in  N,\fO!  ,  let  X  '  =  .  ,  u<  R 

+  ’  II  T  (U  )  S 


Rv  •fheurem  3.2  it  follovs  that  Kn(t)  =’  KXr,(vni 

x  '  t 

—  y  — 

failure  rate.  We  onlv  neet!  to  show  that  K  (t)  r  K  ‘  C,<  X  )  enjoys 

x  t 

the  same  property.  Now  let,  ',)  =  {x:  G(x)  is  d  isoont  inuous^  . 


Note  that  X£  increases  to  almost  everywhere  as  n  goes  to 

inf  initv.  Let  Gfx  )  =  1  im  ,  C(yi,  then  GfX°)  converges  to 

y'x  ’  t 

C,  ( X  )  almost  every  where  for  each  t  in  F  .  "v  the  bounded 
t-  '  + 

x  • —  n  -i 

convergence  t hecr «s  we  hav  that  K  GfX  ')  J  ••  -nv urges  to 

Fx !  C  ( V  1  j  for  each,  t  0  .  Since  G  has  countable  numher  of 


t  - 

discontinuities  then  it  follows  from  Theorem  l.C  of  K.esten  [  1 1 J 

that  :>x ( X  *•'  I)>  =  !'•  tor  each  t  0.  IVeref ore,  Kx  G(X  )  =EX  G(X  j  "•=K  (t)  . 
t  t-  t  "  x 

Since  limit  of  increasing  failure  rate  survival  functions  is  an 
increasing  failure  rate  survival  function,  the  result  follows. 

The  following  theorem  is  a  partial  result,  when  G  depends  on 
x  and  t  . 


1.5  THEOREM.  Let  he  given  by  (1.1).  Assume  that  G  depends 

on  x  and  t  .  Then  the  following  holds: 

<  i)  Suppose  that  the  map  x  *G(x,t)  has  increasing  failure  rate  averag 
for  each  t  •  R  ,  the  map  t  ->-G(x,t)  is  decreasing  for  each  x  t  R+ 
and  A  is  starshaped.  Then  has  increasing  failure  rate  average 

for  each  x  e  R+  ; 

(it)  Suppose  that  the  map  x-*-G(x,t)  has  decreasing  failure  rate 
and  the  map  t-*G(x,t)  Is  Increasing  for  each  x *  R+  .  Let  A  be 
ant istarshaped  and  u  <  <  Leb  with  PF^  density.  Then  has 

decreasing  failure  rate  average. 


(iii)  Suppose  that  the  map  (x,t)  -‘•G(x.t)  satisfies  the  property 

G(*+y,  t+s)  ^  G(x,t)  G(y,s)  for  each  x,  y,  t,  s  t  R+.  Let  t.  he 

superadditive.  Then,  for  each  x,t,seR+  and  at  (0,1),  we  have 

F  (t+s)  <  p  (t)  F...  .  (s).  In  particular  F„  is  new  better  than 

x  ax  (l-a)x  0 

used. 

(iv)  Suppose  that  the  map  ix,t)  -*■  G(x,t)  satisfies  the  property 

G(x+y,  t+s)  2  G(x,t)  G(y,s)  for  each  x,  y,  t,  s  e  R+.  Let  A  be 

subadditive.  Then  f  is  new  worse  than  used. 

X  _ 

PROOF  OF  (i).  Define  H  (t)  =  EX[G(X  ,t)]  .  It  is  sufficient 

. —  "  —  x  t 

to  show  that  for  each  A  e  R+  :  H  (t)  -  e  *  C  changes  sign 

at  most  once  and  if  once  in  the  order  +  ,  -  . 

Fix  A  and  let  t*  be  the  point  where  such  a  change  occurrs. 

Define,  H'(t)  *  EX  G(Xt,t').  By  Theorems  2.2  and  2.4  it  follows  that 

H'(t)  -  e~^t  changes  sign  once  and  in  the  order  +,  -  .  Thus, 

lV(t)  2  e  Xt  for  t  <  t'  and  H^(t)  s  e  Xt  for  t  2  t'  .  Since 

t  ■+  G(x,t)  is  decreasing  in  t  for  each  x  e  R+,  then 
[^(t)  >  H^(t)  for  t  s  t'  while  H^Ct)  s  H^(t)  for  t  >  t'  . 

Therefore,  H^Ct)  -  e  ^  for  t  S  t'  and  Hx(t)  <  e  for  t  >  t', 

i.e.  Nx(t)  ~  e  ^  changes  sign  once  and  from  +  to  -  . 

PROOF  OF  (li).  It  is  necessary  and  sufficient  to  show  that  for  each 
A  e  R+,  Fg(t)  -  e  changes  sign  at  most  once  and  if  once  in  the 
order  -,  +  .  Fix  A  and  let  t'  be  the  point  where  such  a  change 
occurrs.  Define,  Kg(t)  *  E  G(Xt»t').  By  virtue  of  Theorems  2.2 
and  2  .4  it  follows  that  K' (t)  -  e  changes  in  the  order  -,  +. 

Thus,  Kg(t)  s  e  for  t  £  t’  and  Kg(t)  2  e  >'t  for  t  2  t'. 

Since  t  -*■  G(x, t)  is  increasing  in  t  for  each  x  e  R+,  then 

K0(t)  s  K’(t)  for  t  s  t'  and  KQ(t)  2Kj(t)  for  t  2  t\ 

Therefore  K^(t)  s  e  for  t  S  t*  and  Kg(t)  2  * 

Hence,  K^ft)  -  changes  si fp  once  in  the  order  + 


for  t  2  t'  . 
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PROOF  OF  (lii).  We  need  to  show  that  H  (t+s)  <  H  (t)H  (s). 

x  ax  (  1-a) x 

Observe  that  H^Ct+s)  =  EX[g(  X^  ^  t+g  ^ ,  t+s  )] 


S  EraXA(t)+*(S)+  *•  t+s)] 


eCg(x 


A(  t )+A(s )~  XA(s)+  aX  +  XA(s)+( 1_a)x*  t+s)^ 


E[G(X 


A(t)+A(s)'  XA(s)+  “X*  t)C(XA(s)+(l-a)x.s)] 


=  E[G(XA{t)  +ax,t)]  E  [G(XA(s)+( l-a)x,s)] 

£By  the  stationarlty  and  independence  of 
the  increments] 

■  t).o 


Fax<t)T(l-a)x(8) 


PROOF  OF  (lv).  The  proof  of  (iv)  is  similar  to  the  proof  of  (iii), 
and  hence  is  omitted. 


III.  OPTIMAL  REPLACEMENT  POLICY. 


In  this  section  we  deal  with  the  problem  of  finding  the  optimal 
replacement  policy  that  minimizes  the  average  cost  per  unit  time  for 
devices  subject  to  the  type  of  wear  processes  described  in  Section  I. 
Define 


and 
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t  <  ; 

t  ?  c 


Note  that 


Zt  ZA(t) 


and 


Z  =  Z  .  ,  ,  t  c  R 

t  T  ( t )  *  + 


The  process  Z  is  obtained  by  killing  the  wear  process  X  at  the  failure 

time  of  the  device  and  sending  it  Co  "iternity".  The  process  Z  is 

obtained  from  X  similarly.  For  teR.  let  F  =  o(Z  ,  s<t)  and 

+  t  s 

F  =  o(Z  ,  s<t)  . 
t  s 

Devices  subject  to  the  wear  process  Z  are  replaced  at  or  after 

failure  at  a  constant  cost  c.  Replacements  before  failure  depends  on 

the  accumulated  wear  at  time  of  replacement  and  is  denoted  by  c(*). 

Naturally  we  assume  that  the  cost  of  replacement  before  failure  does 

not  exceed  the  cost  of  replacement  at  or  after  failure.  We  will  deal 

only  with  Markovian  replacement  times  with  respect  to  the  history 

(F  ).  By  a  Markovian  replacement  time  we  simply  mean  a  stopping  time 

with  respect  to  the  cononical  history  (F^). 

For  each  Markovian  replacement  time  t  the  average  cost  per  unit 

t  ime  ill  is  of  the  form 
T 

♦T(X)  -  iexCc(ZT)i(x<i;)]  +  cPx(t20)/ex(t)  , 

For  each  x  in  R+  let  Cj(x)  •  c  -  c(x)  ,  xcA  and  equals  to  zero  for 
x  in  the  complement  of  A  with  respect  to  TT+.  Note  that 
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i>  (x)  =  {-EXCc(Z  )]*c}/E*(t)  . 

T  T 

We  will  give  sufficient  conditions  on  the  cost  function  c  that 
guarantees  that  the  optimal  replacement  policy  that  minimizes  the 
expected  cost  per  unit  time  is  a  control  policy.  Since  ij^(x);0  for 
each  r  for  which  E  (t)  -  we  will  only  concern  ourselves  with 
those  Markovian  replacement  times  for  which  E  (t)<^  ,  xcR+.  Denote 
the  class  of  such  replacement  times  by  U. 

3. 1  REMARK.  Let  U  be  the  class  of  Markovian  stopping  times,  t  , 
with  respect  to  the  history  (F  )  such  that  Ex(t)<°°  ,  xeR+  .  Note 
that  x  belongs  to  U  if  and  only  if  A(x)  belongs  to  U. 

The  following  proposition  gives  sufficient  condition  for  the 
finiteness  of  the  expected  failure  time. 

3.2.  PROPOSITION.  Assume  that  the  map  x-M3(x,t)  has  increasing 
failure  rate  average  for  each  t  e  R  ,  and  the  map  t  >-G(x,t)  is 
decreasing  for  each  x  *  R+  and  A  is  starshaped.  Then  E  (O  is 
finite  for  all  x  e  R+. 

—  ~X 

PROOF .  From  Theorem  2.5  we  know  that  F^(t)  m  P  >  t)  has  increasing 

failure  rate  average.  Therefore  there  exists  X  and  t°  e  R+  such 

that  F  (t)  >  e_Xt  for  t  <  t°  and  F  (t)  <  e*Xt  for  t  >  t°. 

X  x 

Therefore,  m 

E*(C)  "  F  (t)dt 
X 

,  t®  {<*> 

<>  F  (t)dt  +  I  e"Xtdt 

Jo  x  'to 


<  » 
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Let  bB(A)  be  the  class  of  bounded  Borei  measurable  functions 
whose  domain  is  A.  Every  function  in  this  class  is  extended  to  R+ 
by  defining  it  to  be  equal  to  zero  outside  A.  We  denote  the  class  of 
such  functions  by  dp.  For  the  stationary  process  Z  we  define  the 
semigroup  on  6^  by  Q^f(x)  =  E*f.  f(X^)  I  for  x  in  A  and  Q^f(x)  0 
for  x  outside  A.  From  the  definition  of  E  it  follows  that 

Q^f(x)  =  EXCf ( )G( )3/G( Xq ) ]  for  x  in  A  and  equals  to 
zero  for  x  outside  A. 

For  functions  in  r  the  infinitsimal  generator 

Q  f  -  f 

:  --  lit.  - - - ,  where  the  limit  is  ta'.er  *  h<  the  uniform  lit.it. 

t  •  *0  x 

lie  let  Dfnl  •' !'  ■  irl  :  'If  exists':  .  Then,  !'(H  is  called  t  :  e 

o 

domain  of  the  generator. 

For  anv  function  f  t  6  we  define  h:R  *  R  -  R  by 

0  +  + 

h ( x , y )  =  C.  1(x)[f(x  +  v )C(y.  +  y)  -  ffx)C(x)], 

and  note  that  sup|h(x,y)l  <  2  ]|f  |  ■«  Define  the  operator 

x,y 

l:bB(A)  ■*  B(A,»  by 

Tf  (x)  =  [  h(x,v);:(dv)  . 

Jro 

Note  that  T  is  not  necessarily  bounded,  since  u  is  not 
necessarily  finite.  However,  if  G  is  differentiable  on  A  and  the  failure 
rate  is  bounded,  then  T  is  bounded  on  the  set  of  function  fed  such 

O 

that  f’  e  6  .  To  see  this  observe  that  adding  and  subtracting 

o 

[f (x)G(x  +  y)]/G(x)  to  the  definition  of  h  and  using  Lagrange's 


Theorem  we  have  that 
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h(x,y)  =  [y/G(x)  ][-G'  (x  +  <?,y)f(x)  -  f  1  (x  +  r,7y)C(x  +  v)  ] 

<  y  ( [-G '  (x  +  O^y) /(:(:•;  +  G^yOlux)  -  f  '  (x  +  97y)[cT(x  +  y)/G(x)]f 

It  follows  that  for  each  fed  with  f  '  £  I?  we  have  that 

u  o  * 

for  each  y  e  R+  , 


sup !  h(x,y)  |  <  y[!!f[j  +'lf|!r]. 
x 

=  y  m, 

where  r  is  the  supremum  of  the  failure  rate  and  M  =  [  || f '  ]]  +  '!  f  j1  r ] 

For  such  functions  we  therefore  have  that 

!!  Tf  ||  =  ||  h(x,y)u  (dy)  || 

R„ 


0 


<  M 


yv  (dv)  +  2  j!  f  I! 


■  (dy) 


J  a 


<  CO* 


The  last  inequality  is  true  since  for  Levy  measure  ..  we  have  that 
|  (yAl)u(dy)  <  «  which  is  true  if  and  only  if  y;.  (dv)  «■  ’  and. 


[  ;.(dy)  <  <*- ,  Thus,  for  a  1, 
'  1 

f  1  fa 

<  j  yt. (dy)  +  a!  u(dy)  <  and 
'0  '1 


■a  r  1  ,-a 

yp(dy)  =  .  vu(dy)  +  1  vp(dvl 
J0  J  0  ’  -  1 

foc 

I  h(dv)  <  ®.  This  gives  us  th.e 
*  a 


inequality. 
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The  following  theorem  illustrates  the  fact  that  if  G  is 
differentiable  with  bounded  continuous  failure  rate,  on  its  support, 

then  {f  f  8  :f'  <  b .  c .  8  •-  0(G)  and  Gf  =  Tf. 

o  o 

3.3.  THEOREM.  Assume  that  G  is  differentiable  with  bounded  almost 
everywhere  continuous  failure  rate  on  its  support.  Then, 

def 

H  =  { f  e  b  n  :f'  f  b.c.  f- .  1  c  D(G) 

and 

Gf  =  Tf. 


PROOF.  Consider  for  f  e  H 

Q  f  -  f  , 

[(-£-£ - Tf  jj  =  !!  h(x,y)[-  Qt(dy)  -  u (dy)  D !l  • 


Let  -Q  (dy)  =  ~  yQt(dy).  By  an  argument  similar  to  the  one  used  in 
proving  Theorem  1,  page  302  of  Feller  [8],  it  follows  that 
is  bounded  for  any  a  e  R+  and  nQli/n^a°  »°“)^  <  c  for  a11  n  for 
some  a°  t  R+.  By  Helly’s  Theorem  there  exists  a  sequence  (nk>  such 
that  as  t_1  runs  through  it,  the  measures  tt^Cdy)  converges  weakly 
to  some  measure  fi  over  finite  intervals.  Therefore,  to  see  that  the 
limiting  measure  fi  equals  yp  observe  that  for  each  X  >  0, 


>  i  tK 


-»T. 
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Lai  !  ac  e  :  fans’,  orm  of  >’  is  of  the  ’on: 


-tj  <:  -  o' 


)  =  O 


•.‘‘.'serve  that  for  each  h,  |e 


-Ay  (1 


-hv. 

5  •  >  ,  1  , 

1 - -  '  — (y '  1) , 


the  right-hand  side  of  the  inequality  is  integrable  with  respect  to 
by  properties  of  the  Levy  measure.  Therefore,  by  the  LEBESCUE 
DOMINATED  CONVERGENCE  THEOREM  it  follows  that 

-  ~  '  (1  -  e  y)u(dv)  =  !  e  ,y'vu(dy), 

d/  JR  Jr 

0  0 

which  is  the  Laplace  transform  of  yy.  Upon  differentiating  each 
side  of  the  Laplace  transform  formula  above  with  respect  to  and 

dividing  through  by  t  and  taking  limits  as  t  approaches  zero  we 


e  X>  ~  vQt(dy)  =  e  Xy  yu(dy) 


t-K)  J  R 


Since  —  vQ^  converges  weakly  over  finite  intervals  and  by  the 
uniqueness  of  the  Laplace  transform  the  limiting  measure  is  C  =  yy. 
Let  u(x,y)  =  G  \x)[-G'(x  +  D^y)f(x)  -  f'(x  +  6 ^ ) G C x  +  >')]. 
f®  1  f®  i 

Then,  j  h(x,y)—  Q  (dy)  =  u(x,y)y  —  Q  (dy)  the  last  term  converges 

J0  c  L  J o  1  1 

f3 

u(x,y)yp (dy)  at  each  continuity  point  a  of  yu(dv).  This 

•l0 

convergence  is  uniform  since  u  is  continuous.  Then,  for  any  f  c  H 


we  have 


Q  f  -  f  f  . 

|— - Tf||  -  ||  J  h(x,y)[f  Qt(dy)  -  p(dy)J||  . 

;  R0 
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ar.v  point  o:  cont  ir.uit 


;a-i:  ti-rr.  ip  less  than  or  equal  t  .• 


h<  x  ,  y  (.1  <  (iv  )  1 


hf  (•’.%•)  .  T:  <•  :irst  t  t-rr.  ivv 


.ru  a.-,  t  ’  varies  over  (n,  )  .  The  second  ten:.  i<-  less  than  or  v-.u 


2  f1,'  T  1 ' .  [ a » “ ) 


varies  over  >' n,  )  . 


tr.ir d  term  is  less  than  or  equal  t. 


•  Fa.  •  ••  : 


,  t  h ;  f  term:  ran  he 


ide  snu>.  1 1  enough  by  choosing  a  iaree  enough.  There  tore,  we  conclude 


0  f  -  f 


Tf  I !  -*-0  as  t  -*■  0  through  (n  ) 


ir.e  resuit  then 


: o 1 lows  from  Lemma  3,  page  297  of  Feller  [8],  ■; 

The  proof  of  the  following  proposition  is  obvious  and  hence  is 
omitted . 

1.4 .  PROPOSITION.  Let  b  =  in^  ^  and  assume  that  b  >  0.  Then  the 
following  two  problems  are  equivalent  in  the  sense  that  they  have  the 
same  solution: 

(P  )  minimize  ^  over  all  t  e  U 
def 

(?,)  maximize  =  bE^t)  +  E^c^Z^))  for  all  t  r  L  . 

Finally,  we  state  and  prove  the  key  theorem  in  this  section. 

3.5.  THEOREM.  Let  ce{fe  p  tf’eb.c.B  }.  Suppose  that 

— — .  o  o 

b  +  Gc^(x)  crosses  the  x-axis  at  most  once  and  if  once  then  the 

,wx 

crossing  is  from  above.  Assume  that  E  (4)  <  00  for  all  x  e  R  . 


Def ine 


a  «  inf{x:b  +  Gc^(x)  s  0), 


t  =  inf{t  >  0:Zt  t  [a,*’.]} 


is  the  solution  to  (P^)  and  hence  to  (P^). 


PROOF.  By  Remark  3.1.  It  suffices  to  prove  the  result  for  the 


and  zero  otherwise. 
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and  the  optimal  replacement  policy  is  easily  -mi.  to  be  a  control 
policy  if  c(x)  is  convex  strictly  increasing.  Since  convex 
increasing  functions  approaches  infinity  as  x  approaches  infinity 
and  cfx)  is  bounded  then  A  must  he  finite. 
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